Skip to content

[SYSTEMDS-3927] Out-of-core centralMoment Operations#2339

Closed
janniklinde wants to merge 4 commits into
apache:mainfrom
janniklinde:CentralMomentOOC
Closed

[SYSTEMDS-3927] Out-of-core centralMoment Operations#2339
janniklinde wants to merge 4 commits into
apache:mainfrom
janniklinde:CentralMomentOOC

Conversation

@janniklinde

Copy link
Copy Markdown
Contributor

This patch adds a new out-of-core centralMoment instruction. If a weight matrix is provided, a simple hash-join aligns the matrix blocks (without eviction or back-pressure strategies). Weight matrix support is limited to aligned blocks with matching block-sizes.

@mboehm7

mboehm7 commented Oct 24, 2025

Copy link
Copy Markdown
Contributor

LGTM - thanks for the patch @janniklinde. No changes were needed during the merge, and I like the approach of simultaneously pulling from both input streams which can exploit co-sorted streams.

@mboehm7 mboehm7 closed this in bc3216a Oct 24, 2025
@github-project-automation github-project-automation Bot moved this from In Progress to Done in SystemDS PR Queue Oct 24, 2025
@janniklinde janniklinde deleted the CentralMomentOOC branch January 27, 2026 08:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

2 participants